Smart Test Report

successful login with valid credentials

comprehensive-demo.spec.ts

474ms A (100) Stable ↓ 21% faster ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 603ms Current: 474ms

⏱ Step Timings

Launch browser

251ms

Create context

3ms

Create page

45ms

Navigate to "/"

380ms Slowest

Close context

2ms

Average: 603ms → Current: 474ms

failed login displays error message

comprehensive-demo.spec.ts

1.5s F (39) Flaky → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 0%

Duration Trend

Avg: 1.6s Current: 1.5s

⏱ Step Timings

Create context

3ms

Create page

38ms

Navigate to "/"

372ms Slowest

Close context

2ms

⚠ Error

Error: expect(locator).toBeVisible() failed Locator: locator('#login-error-message') Expected: visible Timeout: 1000ms Error: element(s) not found Call log: - Expect "toBeVisible" with timeout 1000ms - waiting for locator('#login-error-message') at /project/example/comprehensive-demo.spec.ts:15:56

📊 Trace

📦 comprehensive-demo.spec.ts____failed login displays error message-trace-0.zip

./traces/comprehensive-demo.spec.ts____failed login displays error message-trace-0.zip

⬇ Download 🔍 View

📸 Screenshot

🤖 AI Suggestion

Explanation

The test is failing because it is trying to check the visibility of an element with the id #login-error-message, but this element does not exist on the page https://playwright.dev. As a result, the expect assertion fails because it cannot find the element to test its visibility.

Solution

To fix this issue, make sure that the element you are trying to check visibility for actually exists on the page before using the toBeVisible() assertion. You can use a different selector or check for the presence of the element first before checking its visibility.

Here is an updated snippet of code that first checks for the presence of the element before checking its visibility:

javascript

  15 |     const loginErrorMessage = page.locator('#login-error-message');
  16 |     if (await loginErrorMessage.isVisible()) {
  17 |       await expect(loginErrorMessage).toBeVisible({ timeout: 1000 });
  18 |     } else {
  19 |       console.log('Login error message is not present on the page.');
  20 |     }

This code snippet first checks if the loginErrorMessage locator is visible on the page before attempting to check its visibility using toBeVisible() function.

Average: 1.6s → Current: 1.5s

password reset flow works correctly

comprehensive-demo.spec.ts

589ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 556ms Current: 589ms

⏱ Step Timings

Launch browser

98ms

Create context

4ms

Create page

45ms

Navigate to "/"

488ms Slowest

Close context

2ms

Average: 556ms → Current: 589ms

session expires after inactivity

comprehensive-demo.spec.ts

586ms A (100) Stable ↓ 60% faster ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 1.5s Current: 586ms

⏱ Step Timings

Create context

2ms

Create page

40ms

Navigate to "/"

498ms Slowest

Close context

1ms

Average: 1.5s → Current: 586ms

multi-factor authentication challenge

comprehensive-demo.spec.ts

578ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 497ms Current: 578ms

⏱ Step Timings

Create context

1ms

Create page

40ms

Navigate to "/"

493ms Slowest

Close context

2ms

Average: 497ms → Current: 578ms

create new user account

comprehensive-demo.spec.ts

530ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 518ms Current: 530ms

⏱ Step Timings

Create context

1ms

Create page

38ms

Navigate to "/"

447ms Slowest

Close context

1ms

Average: 518ms → Current: 530ms

update user profile information

comprehensive-demo.spec.ts

487ms B (84) Flaky ↓ 34% faster ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 60%

Duration Trend

Avg: 742ms Current: 487ms

⏱ Step Timings

Create context

1ms

Create page

39ms

Navigate to "/"

403ms Slowest

Close context

2ms

Average: 742ms → Current: 487ms

delete user account with confirmation

comprehensive-demo.spec.ts

472ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 556ms Current: 472ms

⏱ Step Timings

Create context

1ms

Create page

38ms

Navigate to "/"

394ms Slowest

Close context

3ms

Average: 556ms → Current: 472ms

user permissions are enforced correctly

comprehensive-demo.spec.ts

452ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 512ms Current: 452ms

⏱ Step Timings

Create context

1ms

Create page

39ms

Navigate to "/"

371ms Slowest

Close context

2ms

Average: 512ms → Current: 452ms

avatar upload and processing

comprehensive-demo.spec.ts

3.1s A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 3.1s Current: 3.1s

⏱ Step Timings

Create context

1ms

Create page

39ms

Navigate to "/"

483ms

Wait for timeout

2.5s Slowest

Close context

2ms

Average: 3.1s → Current: 3.1s

add single item to cart

comprehensive-demo.spec.ts

524ms A (100) Stable ↓ 57% faster ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 1.2s Current: 524ms

⏱ Step Timings

Create context

2ms

Create page

42ms

Navigate to "/"

438ms Slowest

Close context

1ms

Average: 1.2s → Current: 524ms

add multiple items to cart

comprehensive-demo.spec.ts

487ms A (100) Stable ↓ 61% faster ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 1.3s Current: 487ms

⏱ Step Timings

Create context

1ms

Create page

38ms

Navigate to "/"

406ms Slowest

Close context

2ms

Average: 1.3s → Current: 487ms

remove item from cart

comprehensive-demo.spec.ts

587ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 503ms Current: 587ms

⏱ Step Timings

Create context

1ms

Create page

38ms

Navigate to "/"

507ms Slowest

Close context

2ms

Average: 503ms → Current: 587ms

update item quantity in cart

comprehensive-demo.spec.ts

547ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 524ms Current: 547ms

⏱ Step Timings

Create context

1ms

Create page

40ms

Navigate to "/"

468ms Slowest

Close context

2ms

Average: 524ms → Current: 547ms

apply discount code successfully

comprehensive-demo.spec.ts

1.6s F (39) Flaky → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 0%

Duration Trend

Avg: 1.6s Current: 1.6s

⏱ Step Timings

Create context

1ms

Create page

39ms

Navigate to "/"

443ms Slowest

Close context

2ms

⚠ Error

Error: expect(locator).toBeVisible() failed Locator: locator('#discount-applied') Expected: visible Timeout: 1000ms Error: element(s) not found Call log: - Expect "toBeVisible" with timeout 1000ms - waiting for locator('#discount-applied') at /project/example/comprehensive-demo.spec.ts:98:53

📊 Trace

📦 comprehensive-demo.spec.ts____apply discount code successfully-trace-0.zip

./traces/comprehensive-demo.spec.ts____apply discount code successfully-trace-0.zip

⬇ Download 🔍 View

📸 Screenshot

🤖 AI Suggestion

Explanation

The error message indicates that the element with the locator #discount-applied was not found within the specified timeout of 1000 ms. This means that the test failed to find the element on the page and verify its visibility.

This could be due to different factors such as the element not being present on the page, the timing of the test script execution, or dynamic content loading. To address this issue, you can add a waiting strategy to ensure the element is present before checking its visibility.

Solution

You can use the waitForSelector function to wait for the element to be present on the page before checking its visibility. Here's a code snippet that incorporates this fix:

typescript

await page.goto('https://playwright.dev');
await page.waitForSelector('#discount-applied');
await expect(page.locator('#discount-applied')).toBeVisible({ timeout: 1000 });

Adding waitForSelector before the expect statement ensures that the element is available on the page before checking its visibility, reducing the likelihood of test failures due to element absence.

Average: 1.6s → Current: 1.6s

invalid discount code shows error

comprehensive-demo.spec.ts

638ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 569ms Current: 638ms

⏱ Step Timings

Launch browser

97ms

Create context

3ms

Create page

47ms

Navigate to "/"

535ms Slowest

Close context

2ms

Average: 569ms → Current: 638ms

cart persists across sessions

comprehensive-demo.spec.ts

484ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 513ms Current: 484ms

⏱ Step Timings

Create context

1ms

Create page

38ms

Navigate to "/"

402ms Slowest

Close context

1ms

Average: 513ms → Current: 484ms

cart total calculates correctly

comprehensive-demo.spec.ts

572ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 494ms Current: 572ms

⏱ Step Timings

Create context

1ms

Create page

39ms

Navigate to "/"

485ms Slowest

Close context

1ms

Average: 494ms → Current: 572ms

guest checkout flow

comprehensive-demo.spec.ts

479ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 503ms Current: 479ms

⏱ Step Timings

Create context

1ms

Create page

38ms

Navigate to "/"

400ms Slowest

Close context

2ms

Average: 503ms → Current: 479ms

registered user checkout

comprehensive-demo.spec.ts

523ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 549ms Current: 523ms

⏱ Step Timings

Create context

1ms

Create page

38ms

Navigate to "/"

443ms Slowest

Close context

4ms

Average: 549ms → Current: 523ms

shipping address validation

comprehensive-demo.spec.ts

659ms A (93) Stable ↑ 24% slower ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 531ms Current: 659ms

⏱ Step Timings

Create context

3ms

Create page

38ms

Navigate to "/"

578ms Slowest

Close context

2ms

Average: 531ms → Current: 659ms

payment processing with valid card

comprehensive-demo.spec.ts

3.5s A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 3.6s Current: 3.5s

⏱ Step Timings

Create context

0ms

Create page

39ms

Navigate to "/"

395ms

Wait for timeout

3.0s Slowest

Close context

1ms

Average: 3.6s → Current: 3.5s

payment declined handling

comprehensive-demo.spec.ts

2.1s F (39) Flaky → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 0%

Duration Trend

Avg: 2.1s Current: 2.1s

⏱ Step Timings

Create context

1ms

Create page

43ms

Navigate to "/"

410ms Slowest

Close context

1ms

⚠ Error

Error: expect(locator).toBeVisible() failed Locator: locator('#payment-declined-error') Expected: visible Timeout: 1500ms Error: element(s) not found Call log: - Expect "toBeVisible" with timeout 1500ms - waiting for locator('#payment-declined-error') at /project/example/comprehensive-demo.spec.ts:145:59

📊 Trace

📦 comprehensive-demo.spec.ts____payment declined handling-trace-0.zip

./traces/comprehensive-demo.spec.ts____payment declined handling-trace-0.zip

⬇ Download 🔍 View

📸 Screenshot

🤖 AI Suggestion

Explanation

The error is occurring because the element with the locator '#payment-declined-error' is not being found on the page. This could be due to a timing issue where the element is not yet loaded when the test checks for its visibility.

Solution

To address this issue, you can add a wait for the element to appear on the page before checking its visibility. You can use waitForSelector in Playwright to ensure the element is present before using toBeVisible.

Here's a code snippet showing how to fix this:

javascript

await page.goto('https://playwright.dev');
// Wait for the element to appear on the page
await page.waitForSelector('#payment-declined-error');
// Check if the element is visible
await expect(page.locator('#payment-declined-error')).toBeVisible({ timeout: 1500 });

Average: 2.1s → Current: 2.1s

order confirmation email sent

comprehensive-demo.spec.ts

677ms A (100) Stable ↓ 46% faster ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 1.3s Current: 677ms

⏱ Step Timings

Launch browser

98ms

Create context

4ms

Create page

45ms

Navigate to "/"

576ms Slowest

Close context

2ms

Average: 1.3s → Current: 677ms

order summary displays correctly

comprehensive-demo.spec.ts

499ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 504ms Current: 499ms

⏱ Step Timings

Create context

2ms

Create page

39ms

Navigate to "/"

412ms Slowest

Close context

1ms

Average: 504ms → Current: 499ms

basic search returns results

comprehensive-demo.spec.ts

471ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 503ms Current: 471ms

⏱ Step Timings

Create context

1ms

Create page

39ms

Navigate to "/"

393ms Slowest

Close context

2ms

Average: 503ms → Current: 471ms

search with filters applied

comprehensive-demo.spec.ts

521ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 534ms Current: 521ms

⏱ Step Timings

Create context

1ms

Create page

39ms

Navigate to "/"

440ms Slowest

Close context

2ms

Average: 534ms → Current: 521ms

search autocomplete suggestions

comprehensive-demo.spec.ts

572ms B (89) Unstable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 80%

Duration Trend

Avg: 637ms Current: 572ms

⏱ Step Timings

Create context

1ms

Create page

41ms

Navigate to "/"

487ms Slowest

Close context

2ms

Average: 637ms → Current: 572ms

no results handling

comprehensive-demo.spec.ts

505ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 576ms Current: 505ms

⏱ Step Timings

Create context

1ms

Create page

37ms

Navigate to "/"

421ms Slowest

Close context

2ms

Average: 576ms → Current: 505ms

search pagination works

comprehensive-demo.spec.ts

461ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 529ms Current: 461ms

⏱ Step Timings

Create context

1ms

Create page

39ms

Navigate to "/"

381ms Slowest

Close context

1ms

Average: 529ms → Current: 461ms

search history is saved

comprehensive-demo.spec.ts

3.6s C (78) Stable ↑ 195% slower ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 1.2s Current: 3.6s

⏱ Step Timings

Create context

2ms

Create page

38ms

Navigate to "/"

3.5s Slowest

Close context

2ms

Average: 1.2s → Current: 3.6s

product details display correctly

comprehensive-demo.spec.ts

504ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 539ms Current: 504ms

⏱ Step Timings

Create context

2ms

Create page

40ms

Navigate to "/"

421ms Slowest

Close context

2ms

Average: 539ms → Current: 504ms

product images load properly

comprehensive-demo.spec.ts

454ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 501ms Current: 454ms

⏱ Step Timings

Create context

1ms

Create page

39ms

Navigate to "/"

378ms Slowest

Close context

1ms

Average: 501ms → Current: 454ms

product reviews are visible

comprehensive-demo.spec.ts

472ms A (97) Stable → Stable ▶

📊 Run History (Last 5 runs)

Pass/Fail

Pass rate: 100%

Duration Trend

Avg: 516ms Current: 472ms

⏱ Step Timings

Create context

1ms

Create page

39ms

Navigate to "/"

389ms Slowest

Close context

1ms

Average: 516ms → Current: 472ms

Overview

Trends

✅ Pass Rate

⏱️ Duration

🟡 Flaky Tests

🐢 Slow Tests

Run Comparison

Attachments Gallery

Explanation

Solution

Explanation

Solution

Explanation

Solution